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Status 

1 )^| Responsive to communication(s) filed on 08 December 2008 . 
2a )□ This action is FINAL. 2b)£3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 
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5) D Claim(s) is/are allowed. 

6) |EI Claim(s) 1,9,11,12,14,25,26 and 28-30 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) L~H The specification is objected to by the Examiner. 
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DETAILED ACTION 

Application Background 

1. This action is responsive to the Request for Continued Examination filed on 
12/8/2008. 

2. Applicant has amended claims 1, 9, 12, 25, 26 and 28-30, and canceled claims 
2-6 and 27. Claims 7, 8, 10, 13 and 15-24 were previously canceled. 

3. Claims 1, 9, 11, 12, 14, 25, 26 and 28-30 are pending in the case; claims 1, 9, 12 
and 25 are independent claims. 

4. Acknowledgement is made to the applicant's submission of an Information 
Disclosure Statement, filed on 6/30/2008. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

"(a) A patent may not be obtained though the invention is not identically disclosed 
or described as set forth in section 102 of this title, if the differences between the 
subject matter sought to be patented and the prior art are such that the subject 
matter as a whole would have been obvious at the time the invention was made 
to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was 
made. " 

6. Claims 1, 9, 12 and 25 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Escobar et al. US Patent 5,659,793, filed 12/22/1994, patented 
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8/19/1997, (hereinafter "Escobar) in view of Wittenburg et al. US Patent 6,515,656, 
filed 4/30/1999, patented 2/4/2003, (hereinafter "Wittenburg"). 

7. Regarding independent claim 1, the applicant defines temporal and 
nontemporal media as "temporal media, such as video, audio and computer- 
generated animation, and nontemporal media, such as still images, text, hypertext 
documents etc" (page 4, lines 12-14). Escobar discloses in Figure 1, a graphical 
user interface for authoring presentations, with a temporal media timeline (shown as 
"Video Time Line" at reference signs 140 and 141), nontemporal media timelines 
(shown as "Program Object Time Line" at reference sign 160). 

Escobar discloses a viewer having access to and using the timeline to display the 
media presentation. Escobar recites "Button 174 permits part or all of an application 
under development to be run and displayed at a location specified, typically in the 
Display/Edit Window 100, so that the impact of the decisions made in editing of a 
portion or all of an application may be viewed under run time conditions" (column 6, 
lines 41-45). Escobar further recites: "Button 173 invokes application creation or 
editing functions which permit objects to be assembled into applications with relative 
timing specified by their placement along the timeline tracks" (column 6, lines 37-41 ). 

Escobar discloses an encoder to output a media presentation from the timeline. 
Escobar recites: "the objects can be combined and only the combined integrated 
final application can be sent as a live program" (column 20, lines31-33). 

Escobar discloses a graphical user interface for authoring presentations with 
temporal and nontemporal media and their timelines for the multimedia presentation. 
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Escobar fails to disclose data that defines the portion of the display area in which of 
the first and second media tracks will be displayed (i.e. the spatial relationship). 
Wittenburg teaches controlling the spatial relationships of the display of the media 
objects. Wittenburg recites: "The techniques described are capable of using a 
number of different spatial layout techniques and transitions for rendering individual 
multimedia data items to be presented in a particular presentation area" (column 14, 
lines 39-42). Wittenburg further illustrates several presentations with spatially related 
media objects in Figures 6-10. Wittenburg discloses a user modifying the data 
defining the spatial relationships - see claim 18. 

Therefore, it would have been obvious, to one of ordinary skill, at the time the 
invention was made, to combine the multimedia authoring tool of Escobar with the 
use of spatial relationships, as taught by Wittenburg, in order to create "a technique 
for viewing and selecting information by incorporating imagery and other media, as 
well as text, that uses a hierarchical organization, and deploys controls for speed 
and direction of information presented' (Wittenburg, column 2, lines 19-23). 

8. Regarding independent claim 9, the claim contains substantially the same 
subject matter as claim 1 , and remains rejected using the same rationale. 

9. Regarding independent claim 12, the claim contains substantially the same 
subject matter as claim 1 , and remains rejected using the same rationale. 
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10. Regarding independent claim 25, the claim is directed toward a computer 
program product for the system of claim 1 , and remains rejected using the same 
rationale. 

11. Claims 11, 14, 26 and 28-30 remain rejected under 35 U.S.C. 103(a) as being 
unpatentable over Escobar in view of Wittenburg, and in further view of Gill et al. US 
Patent 6,081,262, filed 12/4/1996, patented 6/27/2000, (hereinafter "G/Vf). 

12. Regarding amended dependent claim 11, Escobar and Wittenburg disclose a 
multimedia authoring system using timelines of temporal and nontemporal media. 
Escobar and Wittenburg fail to disclose the use of a time bar to manipulate the 
media time lines. Gill discloses the use of a time bar in Figure 2, at reference sign 
PL. 

Therefore, it would have been obvious, to one of ordinary skill, at the time the 
invention was made to combine the multimedia authoring system of Escobar and 
Bergman with the controllable time bar of Gill in order "to combine media objects of 
multiple diverse types into an integrated multi-media presentation" (Gill, Column 1, 
lines 8-10). 

13. Regarding dependent claims 14 and 26, the claims contain substantially the 
same subject matter as claim 1 1 , and remain rejected using the same rationale. 

14. Regarding dependent claim 28, Escobar and Wittenburg disclose a multimedia 
authoring system using timelines and spatial relationships of temporal and 
nontemporal media. Escobar and Wittenburg fail to disclose the display area divided 
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into frames. Gill teaches the use of display frames. Gill Discloses in Figure 2, a text 
frame (shown at reference sign TB) and a movie frame (shown at reference sign 
MB). 

Therefore, it would have been obvious, to one of ordinary skill, at the time the 
invention was made to combine the multimedia authoring system of Escobar and 
Bergman with the display frames of Gill in order "to combine media objects of 
multiple diverse types into an integrated multi-media presentation" (Gill, Column 1, 
lines 8-10). 

15. Regarding dependent claims 29 and 30, Escobar, Wittenburg and Gill disclose 
a multimedia authoring system using timelines and spatial relationships of temporal 
and nontemporal media. Escobar and Gill fail to disclose the multimedia 
presentation defined by a markup language document (claim 29) and where the 
markup language document contains additional nontemporal media (claim 30). 
Wittenburg discloses the use of markup language documents with nontemporal 
media. Wittenburg recites: "user interface components may include, for example, 
JAVA Script code and data, and dynamic HTML files" (column 4, lines 36-38). 

Therefore, it would have been obvious, to one of ordinary skill, at the time the 
invention was made, to represent the multimedia presentation of Escobar and Gill as 
a markup language document with additional content, as taught by Wittenburg, in 
order to create "a technique for viewing and selecting information by incorporating 
imagery and other media, as well as text, that uses a hierarchical organization, and 
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deploys controls for speed and direction of information presented' (Wittenburg, 
column 2, lines 19-23). 

Response to Arguments 

16. Applicant's arguments filed 12/8/2008 have been fully considered but they are 
not persuasive. 

17. Regarding independent claim 1, applicant argues that Escobar fails to disclose 
the claimed specification (page 7, forth paragraph, of the response dated 
12/8/2088). However, in the response filed 12/8/2008, applicant has canceled the 
"specification" limitation in favor of "data defining the spatial relationship". Applicant 
is directed toward the rejection of claim 1, as stated above. Wittenburg is relied upon 
to show controlling the spatial relationships. 

18. Also regarding independent claim 1, applicant argues that: "Wittenberg ... fails 
to describe how this spatial relationship is achieved' (page 8, fifth paragraph of the 
reply filed 12/8/2008). Applicant is directed to the rejection of claim 1, as restated 
above. Escobar discloses a user authoring a multimedia presentation, as described 
above. Escobar discloses a user modifying the presentation by specifying a position 
for an object along the timeline. The position information is the relationship data for 
the multimedia object. Wittenburg teaches the use of spatial relationships between 
multimedia objects on a display. 
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Conclusion 

19. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gregory J. Vaughn whose telephone number is (571) 
272-4131 . The examiner can normally be reached Monday to Friday from 8:00 am to 
5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen S. Hong can be reached at (571) 272-4124. The fax phone 
number for the organization where this application or proceeding is assigned is (571 ) 
272-2100. 

Information regarding the status of an application may be obtained from the 

Patent Application Information Retrieval (PAIR) system. Status information for 

published applications may be obtained from either Private PAIR or Public PAIR. 

Status information for unpublished applications is available through Private PAIR 

only. For more information about the PAIR system, see http://pair-direct.uspto.gov. 

Should you have questions on access to the Private PAIR system, contact the 

Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

/Stephen S. Hong/ 

Supervisory Patent Examiner, Art 

Unit 2178 

/Gregory J. Vaughn/ 
Patent Examiner 
December 19, 2008 



